© Publication number 0 353 819 

A2 



© EUROPEAN PATENT APPLICATION 



© Application number: 89201976.1 © Int. CIA G06F 9/46 



© Date of filing: 27.07.89 



© Priority: 02.08.88 US 227276 


@ Applicant: N.V. Philips' Gloeilampenfabrieken 




Qroenewoudseweg 1 


® Date of publication of application: 


NL-5621 BA Eindhoven(NL) 


07.02.90 Bulletin 90/06 




© Designated Contracting States: 


© Inventor: Gupta, Rajiv 


C/O INT. OCTROOIBUREAU B.V. Prof. 


DE FR QB 


Holstlaan 6 




NL-5656 AA Elndhoven(NL) 




Inventor: Epstein, Michael Abraham 




c/o INT. OCTROOIBUREAU B.V. Prof. 




Holstlaan 6 




NL-5656 AA Eindhoven(NL) 




© Representative: Strijland, Wilfred et al 




INTERNATIONAAL OCTROOIBUREAU B.V. 




Prof. Holstlaan 6 




NL-5656 AA Eindhoven(NL) 



© Method and apparatus for synchronizing parallel processors using a fuzzy barrier. 




Europaisches Patentamt 
European Patent Office 
Office europ£en des brevets 



© A barrier is used to synchronize parallel processors. The barrier is "fuzzy", i.e. it includes several 
instructions in each instruction stream. None of the processors performing related tasks can execute an 
instruction after its respective fuzzy barrier until the others have finished the instruction immediately preceding 
their respective fuzzy barriers. Processors therefore spend less time waiting for each other. A state machine is 
used to keep track of synchronization states during the synchronization process. 



00 

CO 
IA 
CO 




I 190 i 


I*. 









205 



206 



207 



208 



CL 
LU 



209 



FIG. 2 



Xerox Copy Centre 



EP 0 353 819 A2 



Method and apparatus for synchronizing parallel processors using a fuzzy barrier. 

FIELD OF THE INVENTION 

The invention relates to a method and apparatus for synchronizing parallel processors. In particular the 
invention relates to the use of barriers for such synchronization. 

5 

BACKGROUND OF THE INVENTION 

Known parallel processing systems execute computer code which has been converted into parallel 

10 instruction streams. Dividing computer code into parallel instruction streams has been described, for 
instance, in M. Wolfe et al. "Data Dependence and Its Application to Parallel Processing", International 
Journal of Parallel Programming, Vol. 16. No. 2 April 1987 pp. 137-178. and in H. Stone. High Performance 
Computer Architecture , (Addison Wesley 1987) pp. 321. and 336-338. Some of the streams have lexically 
forward dependences and. or loop carried dependences. The concept of lexically forward dependences is 

■ 5 described m R. Cytron, "Doacross: Beyond Vectonzation for Multiprocessors". 1986 IEEE International 
Conference on Parallel Processing, pp. 836-844. especially at page 838. Loop carried dependences are 
described m M. Wolfe et al. The lexically forward and loop carried dependences lead to a requirement for 
synchronization between the instruction streams. 

Using "barriers" allows for such synchronization. Barriers are points in the respective parallel instruction 

20 streams where the respective parallel processors have to wait to synchronize with each other. The use of 
barriers for synchronization is described in P. Tang et al.. "Processor Self-Scheduling for Multiple-Nested 
Parallel Loops". Proc. 1986 Int. Conf. Parallel Processing, Aug. 1986. pp. 528-535. 

A detailed description of a parallel processing system which uses such stopping points for synchroniza- 
tion can be found in U.S. Patent Numbers 4.344.134; 4.365.292; and 4,412,303 all issued to Barnes, or 

25 Barnes et al. 

In the known parallel processing systems, the individual processors must spend time waiting for each 
other while they are attempting to synchronize. This makes the systems inefficient. The waits may be 
caused m that one processor may execute its assigned code faster than an other processor. An other 
reason for such waits may lie in contention among the various processors for accessing the synchronizing 
30 process or hardware, or in accessing further shared facilities. 



SUMMARY OF THE INVENTION 

35 Among other things, it is an object of the present invention to make parallel processing systems more 
efficient by reducing the amount of time that individual processors must spend waiting for each other. 

This object is achieved by a synchronization apparatus which synchronizes parallel processors so that 
at least one of the processors executes at least one non-idling instruction while awaiting synchronization 
with at least one other processor. A particular category of non-idlding instruction would be those featuring in 

40 user or application programs. Another category could be one instruction related to fulfilling soure task in the 
internal operation of the processor in question other than generating an instruction-determined delay. In 
particular, this object may be realized in identifying and discriminating certain regions of code in the 
respective instruction streams. The regions are referred to herein as "shaded" versus "unshaded". The 
shaded regions are defined herein as "fuzzy" barriers. A processor begins to attempt synchronization upon 

45 reaching a respective shaded region. Synchronization is achieved when no processor executes an 
instruction following its respective shaded region until all processors performing related tasks have finished 
all instructions in the unshaded region preceding their respective corresponding shaded region. 

The object is still further achieved by an apparatus which coordinates synchronization information 
between parallel processors and which uses a state machine to keep track of synchronization information. 

so Further objects and advantages will be apparent from the remainder of the specification and from the 
claims. 



BRIEF DESCRIPTION OF THE DRAWING 
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Figure 1a is a flow chart which describes a method for compiling source code to identify shaded and 
unshaded regions; 

Rgure 1b is a flow chart describing steps for reordering code; 

Figure 2 is a system diagram showing a parallel processing system according to the invention; 
5 Figure 3 is a block diagram of circuit for synchronizing parallel processors; 

Figure 4 is a state diagram of a circuit of Rgure 3; 
Figure 5 is a detailed diagram of the contents of box 304; 
Tables A-D illustrate various apsects of the data processing. 

w 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Figure la is a flow chart showing compilation of source code to create shaded regions. 
In box 101. the compilation starts with source code. An example of some C source code, suitable for 
15 parallel processing follows: 
int a[10][4]: 

for (j + 2: j<10: j+ +) 
for (i=2. i<5; i + +) 
20 a[j][i] = aQ-1][i + 1] + Tj, 

Herein all elements of a two-dimensional integer array a[j][i] are assigned appropriate values. 

In box 102. the compilation identifies part of the code which can be executed on separate processors. 
Box 102 uses the method as described in the above-mentioned book by H. Stone, and article by M. Wolfe 
25 et al. In the source code example, the inner loop can be executed in parallel on separate processors. The 
code for the inner loop would then look as in Table A. wherein brr stands for barrier. 

The barriers were inserted because of loop carried dependences. In other words, in the example, the 
value of a[1][3] computed by processor P2 in the first iteration of the loop is needed by processor P1 in the 
second iteration. In the prior art, each of the three processors would have to wait in each loop until each of 
30 the other processors reached the point marked barrier. 

In box 103. the compilation generates intermediate code, using standard techniques. In what follows, 
the intermediate code will be expressed in a standard notation called "three address code". This code and 
techniques for generating it are described A. Aho et al. Principles of Compiler Design , (Addison Wesley 
1979) Ch. 7. " " ——— "' 

35 In the example, the intermediate code for the three processors will be the same except for the value of 
"i" which is initialized to 2. 3. and 4 for processors P1, P2, and P3, respectively. 

Box 104 identifies shaded and unshaded regions. The shaded regions will constitute fuzzy barriers. In 
other words, as in the case of the traditional barrier, when a processor reaches a shaded region it will want 
to synchronize. However, in contrast with the prior art. in the case of the fuzzy barrier, or shaded region, the 
40 processor will be able to continue executing instructions while waiting to synchronize. The unshaded 
regions will constitute areas where the processors do not seek to synchronize. 

After box 104. the intermediate code will be as shown in Table B, an appropriate Comment at the start 
being: 

Comment: Let A be the base address of array a; 

45 and a second comment after the first interrupted line: 
Comment: unshaded region. 

Box 104 finds these shaded and unshaded region as follows. The default, i.e. in case no unshaded 
region is identified, is for instructions to be in a shaded region. This default is set because the processor 
can never stall while executing instructions in the shaded region. Shaded regions are therefore preferred. 

so Rnding the unshaded part includes two main steps. First, the first and last instructions with lexically 
forward dependences and/or loop carried dependences LFD are identified as unshaded. Then all of the 
instructions between those first and last instructions are also unshaded. In the example, 11 and 12 are the 
only instructions with loop carried dependences. During the execution of instruction 11, the processor 
accesses a value that was computed by some other processor in a previous iteration. During execution of 

55 instruction 12, a value that will be used by some other processor in a subsequent iteration is stored in the 
array. Therefore 11 , 12, and all of the instructions between them are unshaded. 

In executing the code, the parallel processors will be "synchronized" if no processor executes an 
instruction in the unshaded region following a shaded region, until all other processors have finished all 
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instructions in the unshaded region preceding the corresponding shaded region. This requirement means 
that those instructions which result in lexically forward and loop carried dependences cannot be executed 
until the dependences are resolved. 

In box 105. the intermediate code is reordered to achieve greater efficiency. Standard reordering 
5 techniques can be used for this purpose. Greater efficiency is achieved as the unshaded regions become 
smaller, because a processor can never be stalled while it is executing instructions in a shaded region. 
Therefore the reordering techniques are applied to reduce the number of instructions in the unshaded 
regions. Therefore, after the reordering, the intermediate code is converted as shown in Table C. with the 
same comments as above. 

to In this reordering, the three instructions between 11 and 12 were moved out of the unshaded region. In 
this example, the three instructions were moved above 11. In some cases, the same effect may be achieved 
by moving instructions past the last instruction with a lexically forward or loop carried dependence. In other 
words, the instructions can be moved out of the unshaded region by moving them upward (above II) or 
downward (below 12). 

15 In reading the above intermediate code, the reader should note that the code is part of a loop. Thus, the 
shaded region after the unshaded region joins the shaded region before the unshaded region, in a 
subsequent iteration. For example, at the end of the first iteration of the loop the first processor can return 
to the beginning of the loop and keep executing code. If all of the other processors have finished their 
respective instructions 12 in their first iterations, the first processor can begin its instruction II on its second 

20 iteration. Since most instructions are in the shaded region, the processors have to spend very little or no 
time waiting for each other: especially, the feature of the shaded regions allows a somewhat less strict 
coupling between the processors. This increased flexibility was found to improve processing speed. 

In box 106, the intermediate code is assembled. For the above example, the VAX assembly code for 
each processor is given in Table D. Assembly is a standard process performed by standard compilers. 

25 During assembly, instructions can be marked as part of the shaded region by turning on a bit reserved for 
that purpose in the instruction. This bit will be called the "l-bit" in what follows. 

One reordering technique, which can be used in box 105 is described in the flowchart of Figure 1b. 
Figure 1b uses the notation Jcnr to refer to instructions not involved in lexically forward or loop carried 
dependences and J LF0 to refer to instructions involved in lexically forward to loop carried dependences. All 

30 instructions of the type Jcnj- are candidates for moving out of the unshaded region. In general, given two 
instructions. J, and J}.,, in that order, then J |M can be moved above j lt if the following conditions are both 
true: 

Condition 1: Jj does not read from a memory location that Jj . i writes to: and 
Condition 2: J, does not write a memory location that J,,, reads from. Figure 1a also assumes an 
35 unshaded region having a sequence of instructions Ji, J 2 . J3 .... J N . 

Box 150 assigns to Jj the first instruction of the type Jcnj-. Box 151 assigns to Jj the first instruction in 
the unshaded region preceding J,. Box 152 loops through instructions Jj through J (t testing Condition 1 and 
Condition 2, for each instruction. If both Condition 1 and Condition 2 are true, for a given instruction, the 
method takes branch 153. If either or both of Condition 1 and Condition 2 are false, then the method takes 
40 branch 154. 

Branch 153 leads to box 155, which tests whether Jj is the last instruction in the unshaded region 
preceding Jj. If the result of the test of bos 155 is false, the method takes branch 156 to box 157, where Jj 
is assigned the next instruction in the unshaded region preceding instruction J { . After box 157 the method 
returns to box 152. 

45 If the result of the test of box 155 is true, the method takes branch 158 to box 159. In box 159, 
instructions Jj is moved out of the unshaded region. The procedure described shows how instructions may 
be moved up. After box 159, the method moves to branch 154. 

If the result of the tests of box 152 are both false, the method takes branch 154 to box 160. In box 160, 
the method tests whether lj is the last instruction of the type Jcnj- in the unshaded region. If the result of the 
so test of box 160 is true, the method of Figure 1b is finished 161. If the result of the test of box 160 is false, 
then the method takes branch 162 to box 163. 

Box 163 assings to Ji the next instruction of the type Jcny-. After box 163, the method of Figure lb 
returns to box 151. 

By performing the above steps on the example, it is determined that the only two instructions which 
55 must be in the unshaded regions are those which are marked 11 and 12. 

A procedure similar to that shown in Figure lb can be applied to move the remaining instructions, 
which do not result in lexically forward or loop carried dependences, down and out of the unshaded region. 
The similar procedure would differ from that described in Figure 1b only in that, instead of comparing an 
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instruction with all preceding instructions in the unshaded region, the compiler should compare it with all 
succeeding instructions. 

Figure 2 is a block diagram of a parallel processing system including four parallel processes 201, 202, 
203 and 204, with respective instruction memories 205. 206, 207, and 208. There may be an arbitrary 

5 number, n, of processors, where n is an integer greater than 2. Four processors are chosen here for ease of 
illustration. The parallel processors 201. 202. 203. and 204 share a data memory 209. Each processor has a 
respective barrier unit 210, 211, 212, and 213. Each barrier unit 210, 211, 212, and 213 has four inputs and 
two outputs. The three inputs from the other processors indicate whether a respective other processor 
wants to synchronize. These inputs will be referred to herein as WANT_IN. The output which goes to the 

w other processors indicates that the respective processor wants to synchronize. These outputs will be 
referred to herein as WANT__OUT. Each barrier unit 210, 211, 212, and 213 also has a respective I input 
from and a respective STALL output to its respective execution unit 213, 214, 215 and 216. 

Figure 3 shows more detail in one of the parallel processors 201 . 202. 203, and 204, including one of 
the barrier units 210. 211, 212. and 213. The barrier unit is for receiving, processing, and sending 

75 synchronization information. The instruction register 301 is shown within an execution unit 328 and is large 
enough to contain the longest instruction in the relevant instruction set, plus the 1-bit 302. The processor is 
assumed to be a RISC processor, which executes one instruction per machine cycle. The 1-bit is turned on 
when the instruction in the instruction register 301 is in a shaded region. The 1-bit is off when the instruction 
is in an unshaded region. 

20 Alternatively, the instruction register 301 can be smaller and instructions can take up several words, if 
logic, not shown, is included for locking out the l-bit 302 except in the first word of the instruction. Another 
alternative approach would be to dedicate an entire instruction in each instruction stream for marking the 
beginnings of the shaded and unshaded regions. Such an approach would require some minor changes to 
the state machine. This approach would add instructions to the respective instruction streams, but would 

25 require fewer changes to existing hardware and machine instructions sets than the l-bit approach. 

The mask register 303. is an internally addressed special register, and has n-1 bits, where n is the 
number of processors in the system. In the present example, it is assumed that n = 4. Each of the 
processors contains the apparatus of Figure 3. Mask register 303 therefore must have 3 bits, to keep track 
of the other processors in the system. The mask register 303 is used to ignore other processors which are 

30 not performing related tasks. A bit of the mask register 303 is turned off when the corresponding other 
processor is performing a related task. A bit of the mask register 303 is turned on when the corresponding 
other processor is not performing a related task. Mask register 303 receives its mask bits from a 3-bit input 
320. In the example, only three processors are needed to execute the code. Therefore two bits of the mask 
register 303 will be off at each processor that is running one of the loops. The third bit will be on, so that 

35 the processors running the loops ignore the one processor that is not running the loops. The compiler 
knows which processors are synchronizing at the barrier and thus can generate an instruction which causes 
appropriate bits to be written to the mask register 303. 

Those processors which are ignored, as a result of the bits of the mask register 303 being on in one 
further processor, can in turn perform independent tasks, ignoring the one further processor by setting their 

40 own mask registers. Such independent tasks can include independent synchronization on an independent 
job requiring parallel processing. 

WANT IN is an n-1 bit input for receiving "WANT" bits from the other processors. The WANT bits will 

be on when the corresponding processors want to synchronize. 

Match circuit 304 contains logic for coordinating the bits in the mask registration 303 and the WANT 

45 bits on input WANT IN. The output of match circuit 304 is called "MATCH" and is on only when all of the 

relevant other processors want to synchronize. 

State machine 305 uses the l-bit and the output MATCH of the match circuit 304 to determine 
synchronization states. State machine 305 outputs two bits: STALL and WANT_OUT. STALL is off when 
the processor is executing instructions. STALL is turned on to stop the processor from executing 

so instructions. WANT_.OUT is turned on when the respective processor wants to synchronize, and is 
otherwise off. 

Figure 4 is a state diagram for the state machine 305. In this embodiment, the state machine 305 is a 
so-called Mealy machine, wherein the outputs STALL and WANT_OUT can change without the machine 
changing states. In Figure 4, inputs to the state machine 305 are indicated in a smaller font and outputs 
55 from the state machine 305 are indicated in bigger font 

Each of the processors 201 , 202, 203, and 204 includes one state machine as described in Figure 4. In 
order for these state machines to work, there must be a common clock or alternate means of synchronizing 
signals between the state machines. For simplicity, the circuitry for synchronizing the state machines 305 is 
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not illustrated in the figures. 

Transition 401 corresponds to remaining in state 0. The machine stays in state 0. while the l-bit is off. In 
other words, the processor is executing an unshaded region of code and is not going to a shaded region of 
code. STALL and WANT_OUT are both off. 
5 Transition 402 takes the machine from state 0 to state 1 . The machine makes transition 402 when its 
respective processor is ready to synchronize, but at least one of the other relevant processors Is not ready 
to synchronize, i.e. when the 1-bit is on and MATCH is off. The conditions 1=0 and MATCH = 0 are denoted 
r and MATCH*, respectively, in Figure 4. During transition 402. WANT_OUT is on and STALL is off. In 
Figure 4. when STALL or WANT_J3UT is off. it is simply omitted. Transition 404 keeps the machine in 
70 state 1. The machine makes transition 404 so long as its wants to synchronize and has not yet done so. but 
is still executing instructions. In other words the machine stays in state 1 while the 1-bit is on and MATCH is 
off. During state 1 , WANTJDUT is on and STALL is off. 

Transition 403 takes the machine from state 0 to state 2. The machine makes transition 403 when its 
respective processor is ready to synchronize, and it is the last of the relevant processors to get to that 
?5 point. Several processors can reach state 2 simultaneously and are thus several simultaneous "last" 
processors. State 2 is a state in which the processor is synchronized. When the state machine 305 is 
making the transition 403. it keeps WANT_OUT on. However, it turns WANT_OUT off when it reaches 
state 2. STALL stays off during transition 403 and state 2. 

Transition 405 takes the machine from state 1 to state 2. The machine makes transition 405 when the 
20 respective processor is still in its shaded region, wanting to synchronize, and all of the other processors 
have reached their respective shaded regions, i.e. when both the 1-bit and MATCH are on. When the 
machine makes transition 405. it keeps the WANT__OUT bit on. STALL is off during transition 405. The 
WANT_OUT bit returns to off. when the machine reaches state 2. 

Transition 406 takes the machine from state 1 to state 3. The machine makes transition 406 when it is 
25 ready to leave its shaded region, but has not been able to make it to state 2. In other words, the 1-bit turns 
off and MATCH is off. At this point, the respective processor must stall. Therefore both WANT-OUT and 
STALL are turned on. 

Transition 407 takes the machine from state 1 to state 0. The machine makes this transition, when 
MATCH turns on and the relevant processor leaves the shaded region simultaneously. The machine keeps 
30 WANT__OUT on during transition 407, and turns it off again when it reaches state 0. STALL remains off 
during transition 407. 

Transition 408 takes the state machine 305 from state 2 to state 0. Transition 408 occurs after 
synchronization, when the 1-bit turns off, i.e. when the respective processor leaves a shaded region. During 
transition 408. WANTJDUT and STALL are both off. 
35 Transition 409 keeps the machine in state 2. Transition 409 occurs after synchronization so long as the 
1-bit remains 1, i.e. so long as the respective parallel processor remains in the shaded region after 
synchronization. During transition 409, WANT_OUT and STALL are both off. 

Transition 411 keeps the machine in state 3, i.e. stalled and waiting to synchronize. The machine makes 
transition 411 so long as MATCH is off. While in state 3 the machine continues to keep both WANT_OUT 
40 and STALL on. 

Transition 410 takes the machine from state 3 to state 0. The machine makes transition 410 when it has 
succeeded in synchronizing with the other machines and can leave its shaded region, in other words when 
MATCH turns on. During transition 410. WANT_OUT stays on. WANT__OUT turns off, once the machine 
reaches state 0. During transition 410, STALL is off. 

45 Figure 5 shows the details of box 304. Th three bits 501, 502, and 503 of mask register 303 are also 
shown in Figure 5. The mask register 303 has three bits because there are three other parallel processors 
in the system. The three bits of WANT_IN are shown as three separate lines WANTJN0, WANT_IN1, 
and WANT_JN2. Mask register bit 503 and WANT_IN0 are fed to OR gate 504. Mask register bit 502 and 
WANT_IN1 are fed to OR gate 505. Mask register bit 501 and WANT_JN2 are fed to OR gate 506. The 

so outputs of OR gates 504, 505, and 506 are fed to AND gate 507. The output of 507 is MATCH. 

The output MATCH is thus on when all of the other processors, which are not being ignored, want to 
synchronize. MATCH is thus also on when all of the other processors are being ignored. 
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TABLE A 

P1U=2) 

for (j=2, j<10; 
( 

a[j][2]=a[j-1][3]+2«ji 

brr; 

> 

TABLE B 



j 


a 


2 


LI: T1 




j - 1 


T2 




16 * T1 


T3 




T2 + A 


T4 




(i+1) * 4 


T5 


3 


i * j 



11: T6 = T4[T3] + T5 


/«T6=a[j-1][i+1]+i*j »/ 


T7 * 16 * j 




T8 = T7 + A 




T9 = i * 4 




12: T9[T8] » T6 


/* a[j][i] * T6 «/ 


j * j + 1 




if j< 10 go to L1 





p2(i=3) 

for (j=2, j<10, j++) 
( 

a[j][3]=a[j-1][4]+3«j; 

brr; 

) 



p3(i»4) 

for j=2, j<10, 
( 

a[j][4]=a[j-1][5]+4*j; 

brr 

> 
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TABLE C 

j = 2 

LI: T1 ■ j - 1 

T2 = 16 * T1 

T3 = T2 + A 

T4 = (i+1) * 4 

T5 = i * j 

T7 16 * j 

T8 * T7 + A 

T9 = i * 4 



II: T6 = T4[T3] + T5 /*T6=a[ j- 1 ][i+1 j* */ 
12: T9[T8] = T6 /* a[j][i] = T6 */ 



j ■ j + 1 

if j< 10 go to L1 

TABLE D 

movab -172(sp),sp roovab -172(sp),sp movab -172(sp),sp 

raovl $2,-4(fp) movl $2,-8(fp) movl $2 f -12(fp) 

L21: moval -172(fp),rO L21: moval -172(fp),rO L21: moval -172{fp),rO 

sub!3 $1,-4(fp),r1 sub!3 $1,-8(fp),r1 subl3 $1,-12(fp) ,r1 

ashl $4,r1,r1 ashl $4,r1,r1 ashl $4,r1,r1 

addl2 r1,r0 addl2 r1,r0 addl2 r1,r0 

ashl $1,-4(fp),r1 mull3 $3,-8<fp),r1 ashl $2, -12(fp) # r1 



addl3 r1,12(r0),r0 
moval -I72(fp),r1 



addl3 r1,16(r0) # r0 
moval -172(fp),r1 



addl3 r1,20(r0),r0 
moval -172{fp) ,r1 



ashl $4,-4(fp),r2 
addl2 r2,r1 
movl r0,8(r1) 
incl -4(fp) 
cmpl -4(fp),$10 
jlss L21 



ashl $4,-8(fp),r2 
addl2 r2,r1 
movl r0,12(r1) 
incl -8(fp) 
cmpl -8(fp),$10 
jlss L21 



ashl $4,-12(fp),r2 
addl2 r2,r1 
movl rO,16(r1) 
incl -12(fp) 
cmpl -12(fp),$10 
jlss L21 



FIGURE LEGENDS 

Figure ta: 101: source code; 102: separate instruction streams; 103: intermediate code; 104: Identify 
shaded and unshaded regions; 105: recorder; 106: assemble. 
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Figure 2: 150: Jj <• first instruction of the type Jmr in the unshaded region; 151: Ji <- first instruction 
in the unshaded region preceding instruction J t ; 152: for instructions Jj, Jj check condition 1 and condition 2; 
155: Ls J, the last instruction in the unshaded region preceding Jj?; 157: Jj <- next instruction in the 
unshaded region preceding instruction Jj; 159: move instruction Jj out of the unshaded region; 160: Is Jj the 
5 last instruction of type Jcnr in the unshaded region?; 163: Ji <- next instruction of the type Junr in the 
unshaded region. 

Figure 2: 190, 192, 194, 196: stall; 210. 211, 212. 213: barrier units: 213, 214, 215, 216: execution 
units: 205. 206. 207, 208: instruction memory; 209: data memory. 

Figure 3: 301: instruction register; 302: barrier bit; 303: mask; 304: match circuit; 305: finite state 
10 machine: 306: want_jn signal line: 307: want_out signal line; 308: stall signal line. 



Claims 

75 1 . A parallel processing system comprising: 

a. a plurality of parallel processors; and 

b. means for synchronizing the processors so that at least one of the processors executes at least 
one non-idling instruction whtle awaiting synchronization with at least one other processor. 

2. An apparatus for synchronizing a parallel processor which is part of a parallel processing system 
20 which includes a plurality of other parallel processors, the system being for executing computer code as a 

plurality of parallel instruction streams, the apparatus comprising: 

a. means for communicating with at least one of the other processors; and 

b. means for controlling the processor, based on information received from the other processors and 
based on a respective instruction stream, so that the processor executes at least one non-idling instruction 

25 while awaiting synchronization with the at least one other processor. 

3. The apparatus of Claim 2 wherein: 

a. the communicating means comprises: 

i. input means means for receiving a received indication from other processors that the other processors 
want to synchronize: and 

30 ii. output means means for sending a sent indication to the other processors that the respective processor 
wants to synchronize; 

b. the controlling means comprises: 

i. means for identifying shaded and unshaded regions in a respective one of the instruction streams; and 

ii. means for controlling execution of the respective one of the instruction streams, in response to the 
35 identification of the shaded and unshaded regions and in response to the received indication, so that the 

respective processor does not execute a respective instruction immediately after a current shaded region 
until the other processors have completed all respective instructions immediately preceding their respective 
current shaded regions, the controlling means being coupled to the input and output means. 

4. The apparatus of Claim 2 further comprising means for ignoring a second at least one of the other 
40 processors, according to a number of parallel instruction streams. 

5. The apparatus of Claim 4 wherein the ignoring means comprises a mask register. 

6. The apparatus of Claim 2 further comprising means for ignoring at least two of the parallel 
processors, according to a number of parallel instruction streams, so that the least two processors 
synchronize independently. 

45 7. The apparatus of Claim 3 wherein the controlling exeuction means is a state machine. 

8. The apparatus of Claim 7 wherein the state machine comprises: 

a. a want input, coupled to the input means of the apparatus, for receiving the received indication; 

b. a second input for receiving a signal identifying the shaded and unshaded regions; 

c. a first output, coupled to the output means of the apparatus, for supplying the sent indication; 

so d. a stall output, coupled to control execution of the respective processor, for supplying a signal for 

stopping execution of the respective processor in a stall state and for otherwise enabling the respective 
processor. 

9. The apparatus of Claim 8 wherein the state machine has four states: 

a. a first state during which the processor executes instructions in the unshaded region; 
55 b. a second state during which the processor executes instructions in the shaded region while waiting 

for other processors to reach their respective shaded regions; 

c. a third state during which the processor executes instructions in the shaded region when the other 
processors have reached their respective shaded regions; and 
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d. a fourth state during which the processor stalls, having reached an end of the shaded region and 
waits for the other processors to reach their respective shaded regions. 

10. The apparatus of Claim 3 further comprising a mask register for ignoring at least one of the other 
processors, according to a number of parallel instruction streams; and wherein the execution controlling 
5 means is a state machine which comprises: 

a. a want input coupled to the input means of the apparatus, for receiving the received indication; 

b. a second input for receiving a signal identifying the shaded and unshaded regions; 

c. a first output, coupled to the output means of the apparatus, for supplying the sent indication; 

d. a stall output coupled to control execution of the respective processor, for supplying a signal for 
w stopping execution of the respective processor in a stall state and for otherwise enabling the respective 

processor. 

1 1 A method for compiling computer code in order to improve the efficiency of a parallel processing 
system, the method comprising the steps of: 

a. a first identifying a plurality of portions of the code which may be executed in parallel in respective 
15 processors of the system; 

b. marking at least one instruction with a lexically forward or loop carried dependence in at least one 
of the portions: 

c. second identifying shaded and unshaded regions within the at least one of the portions. 

12. The method of Claim 1 1 further comprising the steps of: 
20 a. generating intermediate code from the portions: and 

b. converting the intermediate code to assembly language. 

13. The method of Claim 11 further comprising the step of reordering code within the portions so that 
the unshaded regions are reduced in size. 

14. The method of Claim 11 wherein the second identifying step comprises the steps of: 

25 a. first locating a first instruction with a lexically forward or loop carried dependence in the at least 

one of the portions; 

b. second locating a last instruction with a lexically forward or loop carried dependence in the at least 
one of the portions; 

c. designating as unshaded all instructions between the first and last instructions with dependences; 

30 and 

d. designating as shaded all other instructions in the portions. 

15. A method for compiling computer code in order to improve the efficiency of a parallel processing 
system, the method comprising the steps of: 

a. first identifying a plurality of portions of the code which may be executed in parallel in respective 
35 processors of the system; 

b. marking at least one instruction with a lexically forward or loop carried dependence in at least one 
of the portions; and 

c. second identifying shaded and unshaded regions within the at least one of the portions, including 
the steps of: 

40 i. first locating a first instruction with a lexically forward or loop carried dependence in the at least one of the 
portions; 

ii. second locating a last instruction with a lexically forward or loop carried dependence in the at least one of 
the portions; 

iii. designating as unshaded all instructions between the first and last instructions with dependences; and 
45 iv. designating as shaded all other instructions in the portions. 

16. The method of Claim 15 comprising the further steps of 

a. generating intermediate code from the portions; and 

b. converting the intermediate code to assembly language. 

17. A method for synchronizing a plurality of parallel processors comprising the steps of: 

so a. executing related computer code in at least two of the processors, the related computer code 

being in the form of at least two respective parallel instruction streams which include respective shaded and 
unshaded regions, and 

b. controlling the at least two processors so that none of the at least two processors executes an 
instruction following its respective shaded region until ail of the at least two processors have completed all 
55 instructions in the unshaded region preceding their respective corresponding shaded region. 

18. A method for synchronizing parallel processors which execute parallel instruction streams compris- 
ing the step of establishing fuzzy barriers in each of said instruction streams. 
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